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ABSTRACT 
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International Association for the Evaluation of Educational 
Achievement. Forty-five countries collected data in more than 30 
languages. Five grade levels were tested in the two subject areas, so 
that more than half a million students were tested around the world. 
This report addresses middle— school mathematics achievement (grades 
seven and eight) in six content areas: (1) fractions and number 
sense; (2) measurement; (3) proportionality; (4) data representation, 
analysis, and probability; (5) geometry; and (6) algebra. Results 
cover 41 countries with complete data collection. Singapore was the 
top-performing country at both grade levels, with Korea, Japan, and 
Hong Kong also performing very well. There were large differences in 
average achievement between top performers and bottom performing 
nations. Gender differences in mathematics achievement were small or 
nearly nonexistent in most countries, but when they did appear, they 
favored boys. In nearly every country there was a strong positive 
relationship between student enjoyment of mathematics and higher 
achievement. Home factors were strongly related to mathematics 
achievement in every participating country, but relationships between 
instructional variables and achievement were less clear. In every 
country, the pattern was for the eighth grade student whose parents 
had more education to also have higher achievement in mathematics. 

The amount of television viewing was negatively associated with 
mathematics achievement. The document's introduction provides 
information on each country's characteristics including demographics, 
public expenditures on education, organization of educational system. 
Chapters address: (1) International Student Achievement in 
Mathematics; (2) Average Achievement; (3) Performance on Items within 
Each Mathematics Content Area; (4) Students Backgrounds and Attitudes 
towards Mathematics; and (5) Teachers and Instruction. Appendixes 
include: Overview of TIMSS Procedures; Test-Curriculum Matching 
Analysis; Selected Mathematics Achievement Eighth-Grade Results for 
the Philippines, Denmark, Sweden, and German-Speaking Switzerland; 
and Percentiles and Standard Deviations of Mathematics Achievement. 
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—Executive Summary 



Mathematics 



Since its inception in 1959, the International Association for the Evaluation of 
Educational Achievement (IEA) has conducted a series of international comparative 
studies designed to provide policy makers, educators, researchers, and practitioners 
with information about educational achievement and learning contexts. The Third 
International Mathematics and Science Study (TIMSS) is the largest and most 
ambitious of these studies ever undertaken. 

The scope and complexity of TIMSS is enormous. Forty-five countries collected 
data in more than 30 different languages. Five grade levels were tested in the two 
subject areas, totaling more than half a million students tested around the world. 
The success of TIMSS depended on a collaborative effort between the research 
centers in each country responsible for implementing the steps of the project and 
the network of centers responsible for managing the across-country tasks such as 
training country representatives in standardized procedures, selecting comparable 
samples of schools and students, and conducting the various steps required for 
data processing and analysis. Including the administrators in the approximately 
15,000 schools involved, many thousands of individuals around the world were 
involved in the data collection effort. Most countries collected their data in May 
and June of 1995, although those countries on a southern hemisphere schedule 
tested in late 1994, which was the end of their school year. 

Six content dimensions were covered in the TIMSS mathematics tests given to the 
middle-school students: fractions and number sense; measurement; proportionality; 
data representation, analysis, and probability; geometry; and algebra. About one-fourth 
of the questions were in the free-responses format requiring students to generate 
and write their answers. These types of questions, some of which required extended 
responses, were allotted approximately one-third of the testing time. Chapter 3 of 
this report contains 33 example items illustrating the range of mathematics concepts 
and processes addressed by the TIMSS test. 

Because the home, school, and national contexts within which education takes 
place can play important roles in how students learn mathematics, TIMSS collected 
extensive information about such background factors. The students who participated 
in TIMSS completed questionnaires about their home and school experiences related 
to learning mathematics. Also, teachers and school administrators completed 
questionnaires about instructional practices. System-level information was provided 
by each participating country. 

TIMSS was conducted with attention to quality at every step of the way. Rigorous 
procedures were designed specifically to translate the tests, and numerous regional 
training sessions were held in data collection and scoring procedures. Quality 
control monitors observed testing sessions, and sent reports back to the TIMSS 
International Study Center at Boston College. The samples of students selected 
for testing were scrutinized according to rigorous standards designed to prevent 
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bias and ensure comparability. In this publication, the countries are grouped for 
reporting of achievement according to their compliance with the sampling guidelines 
and the level of their participation rates. Prior to analysis, the data from each country 
were subjected to exhaustive checks for adherence to the international formats as 
well as for within-country consistency and comparability across countries. 

The results provided in this report describe students’ mathematics achievement at 
both the seventh and eighth grades. For most, but not all TIMSS countries, the two 
grades tested at the middle-school level represented the seventh and eighth years of 
formal schooling. Special emphasis is placed on the eighth-grade results, including 
selected information about students’ background experiences and teachers’ classroom 
practices in mathematics. Results are reported for the 41 countries that completed 
all of the steps on the schedule necessary to appear in this report. The results for 
students in the third and fourth grades, and for those in their final year of secondary 
school will appear in subsequent reports. 

The following sections summarize the major findings described in this report. 



Students' Mathematics Achievement 

^ Singapore was the top-performing country at both the eighth and 
seventh grades. Korea, Japan, and Hong Kong also performed very 
well at both grades as did Flemish-speaking Belgium and the Czech 
Republic. Lower-performing countries included Colombia, Kuwait, 
and South Africa (see Tables 1.1 and 1.2; Figures 1.1 and 1.2). 

£► Perhaps the most striking finding was the large difference in average 
achievement between the top-performing and bottom-performing 
countries. Despite this large difference, when countries were ordered by 
average achievementt there were only small or negligible differences in 
achievement between one country and the one with the next-lowest 
average achievement. In some sense, at both grades, the results provide 
a chain of overlapping performances, where most countries had 
average achievement similar to a cluster of other countries, but from 
the beginning to the end of the chain there were substantial differences. 
For example, at both grades, average achievement in top-performing 
Singapore was comparable to or even exceeded performance for 95% 
of the students in the lowest-performing countries. 

^ For most countries, gender differences in mathematics achievement were 
small or essentially non-existent. However, the direction of the gender 
differences that did exist favored boys rather than girls. Similarly, 
within the mathematics content areas, there were few differences in 
performance between boys and girls. Again, the few differences that 
did occur favored boys (except in algebra, where, if anything, the 
differences favored girls). 
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£>• Compared to their overall performance in mathematics, nearly all 
countries did relatively better in several content areas than they did in 
others. Consistent with the idea of countries having different emphases 
in curriculum, those that performed relatively better in fractions and 
number sense tended to be different from those that performed relatively 
better in geometry and algebra. 

£► Even though students in the top-performing countries had very high 
achievement on many of the test questions, both seventh and eighth 
graders, in most countries, had difficulty with multi-step problem 
solving and applications. For example, students were asked to actually 
draw a new rectangle whose length was one and one-half times the 
length of a given rectangle and whose width was half the width of 
that rectangle. In only two countries (Korea and Austria) did at least 
half the eighth-grade students correctly draw the new rectangle. 

Students also found the proportionality items difficult. For example, one 
of the least difficult problems in this area asked about adding 5 girls and 
5 boys to a class that was three-fifths girls. On average, fewer than 
two-thirds of the students across countries correctly answered that 
there would still be more girls than boys in the class. 

^ In algebra, 58% of the eighth-grade students across countries, on 
average, identified Am as being equivalent to m + m + m + m. There 
was however, a very large range in performance from country to country. 
Seventy-five percent or more of the eighth graders answered this 
question correctly in the Czech Republic, Hong Kong, Japan, the 
Russian Federation, Singapore, the Slovak Republic, and Slovenia. 

Students' Attitudes Towards Mathematics 

Within nearly every country, a clear positive relationship was observed 
between a stronger liking of mathematics and higher achievement. Even 
though the majority of eighth graders in nearly every country indicated 
they liked mathematics to some degree, clearly not all students feel 
positive about this subject area. In Austria, the Czech Republic, Germany, 
Hungary, Japan, Korea, Lithuania, and the Netherlands, more than 40% 
of the students reported disliking mathematics. 

In no country, did eighth-grade girls report a stronger liking of math- 
ematics than did boys. However, boys reported liking mathematics 
better than girls did in several countries, including Austria, France, 
Germany, Hong Kong, Japan, Norway, and Switzerland. 



► 



► 
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t> In all except four countries, the majority of students agreed or strongly 
agreed that they did well in mathematics - a perception that did not 
always coincide with the comparisons in achievement across countries 
on the TIMSS test. Interestingly, the exceptions included three of the 
highest performing countries - Hong Kong, Japan, and Korea - where 
more than 50% of the students disagreed or strongly disagreed about 
doing well (the fourth was Lithuania). It should be noted, however, 
that within nearly all countries there was a clear relationship between 
perception and performance, with those students reporting higher self- 
perceptions of doing well in mathematics also having higher average 
achievement. 

^ Internationally, the most frequently cited reason for needing to do well 
in mathematics was to get into students’ desired secondary school or 
university. 

Home Environment 

Home factors were strongly related to mathematics achievement in every country 
that participated in TIMSS. 

^ In every country, eighth-grade students who reported having more 
educational resources in the home had higher mathematics achievement 
than those who reported little access to such resources. Strong positive 
relationships were found between mathematics achievement and having 
study aids in the home, including a dictionary, a computer, and a study 
desk/table for the student’s own use. 

^ The number of books in the home can be an indicator of a home 
environment that values and provides general academic support. In most 
TIMSS countries, the more books students reported in the home, the 
higher their mathematics achievement. 

In every country, the pattern was for the eighth-grade students whose 
parents had more education to also have higher achievement in mathematics. 

^ Beyond the one to two hours of daily television viewing reported by close 
to the majority of eighth graders in all participating countries, the amount 
of television students watched was negatively associated with math- 
ematics achievement. 
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^ In most countries, eighth graders reported spending as much out-of-school 
time each day in non-academic activities as they did in academic 
activities. Besides watching television, students reported spending 
several hours, on average, each day playing or talking with friends, and 
nearly two hours playing sports. (It should be noted, however, the time 
spent in these activities is not additive because students can talk with their 
friends at sporting events or while watching TV, for example.) 

Instructional Contexts and Practices 

In comparison to the positive relationships observed between mathematics achievement 
and home factors, the relationships were less clear between achievement and various 
instructional variables, both within and across countries. Obviously, educational 
policies and practices such as tracking and streaming serve to systematically 
confound these relationships. Also, the interaction among instructional variables can 
be extremely complex and merits further study. 

^ The qualifications required for teaching certification were relatively 
uniform across countries. Most countries reported that four years of 
post-secondary education were required, even though there was a 
range from two to six years. Almost all countries reported that teaching 
practice was a requirement, as was an examination or evaluation. 

^ Teachers in most countries reported that mathematics classes typically 
meet for at least two hours a week, but less than three and one-half hours. 

Weekly instructional time of from three and one-half hours up to five 
hours also was common for a number of countries. The data, however, 
revealed no clear pattern between the number of in-class instructional 
hours and mathematics achievement. 

^ There was considerable variation in class size. In a number of countries, 
nearly all students (90% or more) were in classes of fewer than 30 
students. At the other end of the spectrum, 93% of the students in Korea 
were in classes with more than 40 students. The TTMSS data showed 
different patterns of mathematics achievement in relation to class size 
for different countries. 

^ Small-group work was used less frequently than other instructional 
approaches. Across countries, mathematics teachers reported that 
working together as a class with the teacher teaching the whole class, 
and having students work individually with assistance from the teacher 
were the most frequently used instructional approaches. 
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In most participating countries, teachers reported using a textbook in 
teaching mathematics for 95% or more of the students. Relatively 
uniformly, the majority of students were asked both to practice computation 
and do some type of reasoning tasks in most or every lesson. 

Regarding the use of technology, teachers in many countries reported 
three-fourths or more of the eighth graders used calculators almost every 
day in their mathematics classes, often for checking answers, routine 
computation, and solving complex problems. An exception was Korea, 
where it was reported that calculators were seldom used. Teachers and 
students agreed that the computer was almost never used in most students’ 
mathematics lessons. 

Eighth graders in about half the countries reported doing an average of 
two to three hours per day of homework, with those in many countries 
reporting studying mathematics for roughly an hour each day. There 
was a range from half an hour to two hours per day spent on mathematics 
homework and about two to five hours overall, but the relationship 
between amount of homework done and level of mathematics achievement 
was inconsistent. 

Eighth-grade students reported substantial variation in the frequency of 
testing in mathematics classes. In a number of countries, the majority of 
the eighth-grade students reported having quizzes and tests only once 
in while or never. In contrast, one-third or more of the students reported 
almost always having quizzes or tests in Colombia, Hong Kong, Kuwait, 
Romania, Spain, and the United States. 



i — Introduction 



Mathematics 
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As the 21st century approaches, technology is having more and more impact on 
the daily lives of individuals throughout the world. It influences our receipt of 
news and information, how we spend our leisure time, and where we work. At an 
ever-increasing pace, technology also is becoming a major factor in determining 
the economic health of countries. To ensure their economic well-being, countries 
will need citizens prepared to participate in “brain-power” industries such as 
micro-electronics, computers, and telecommunications. The young adolescents of 
today will be seeking jobs in a global economy requiring levels of technical 
competence and flexible thinking that were required by only a few workers in the 
past. To make sensible decisions and participate effectively in a world transformed 
by the ability to exchange all types of information almost instantly, these students 
will need to be well educated in a number of core areas, especially mathematics 
and science. 

The fact that skills in mathematics and science are so critical to economic progress 
in a technologically-based society has led countries to seek information about 
what their school-age populations know and can do in mathematics and science. 
There is interest in what concepts students understand, how well they can apply 
their knowledge to problem-solving situations, and whether they can communicate 
their understandings. Even more vital, countries are desirous of furthering their 
knowledge about what can be done to improve students’ understanding of math- 
ematical concepts, their ability to solve problems, and their attitudes toward 
learning. 

The Third International Mathematics and Science Study (TTMSS) provided countries 
with a vehicle for investigating these issues while expanding their perspectives of 
what is possible beyond the confines of their national borders. It is the most 
ambitious and complex comparative education study in a series of such undertakings 
conducted during the past 37 years by the International Association for the 
Evaluation of Educational Achievement (IEA). 1 The main purpose of TIMSS was 
to focus on educational policies, practices, and outcomes in order to enhance 
mathematics and science learning within and across systems of education. 

With its wealth of information covering more than half a million students at five 
grade levels in 15,000 schools and more than 40 countries around the world, 
TIMSS offers an unprecedented opportunity to examine similarities and differences 
in how mathematics and science education works and how well it works. The 
study used innovative testing approaches and collected extensive information 
about the contexts within which students learn mathematics and science. 



1 The previous IEA mathematics studies were conducted in 1964 and 1980-82, and the science studies in 
1970-71 and 1983-84, For information about TIMSS procedures, see Appendix A. 
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The present report focuses on the mathematics achievement of students in the two 
grades with the largest proportion of 13-year-olds - the seventh and eighth grades in 
most countries. Special emphasis is placed on the eighth-grade results, including 
selected information about students’ background and classroom practices in teaching 
mathematics. 

All countries that participated in TIMSS were to test students in the two grades with 
the largest proportion of 13-year-olds in both mathematics and science. A companion 
report, Science Achievement in the Middle School Years: lEA's Third International 
Mathematics and Science Study (TIMSS), 2 presents corresponding results about 
students’ science achievement. 

Many TIMSS countries also tested the mathematics and science achievement of 
students in the two grades with the largest proportion of 9-year-olds (third and 
fourth grades in most countries) and of students in their final year of secondary 
education. Subsets of students, except the final-year students, also had the opportunity 
to participate in a “hands-on” performance assessment where they designed experiments 
and tested hypotheses. The results of these components of TIMSS will be presented 
in forthcoming reports. 

Together with the achievement tests, TIMSS administered a broad array of background 
questionnaires. The data collected from students, teachers, and school principals, as 
well as the system-level information collected from the participating countries, 
provide an abundance of information for further study and research. TIMSS data 
make it possible to examine differences in current levels of performance in relation 
to a wide variety of variables associated with classroom, school, and national 
contexts within which education takes place. 



Which Countries Participated? 



TIMSS was very much a collaborative process among countries. Table 1 shows the 
45 participating countries. Each participant designated a national center to conduct 
the activities of the study and a National Research Coordinator (NRC) to assume 
responsibility for the successful completion of these tasks. 3 For the sake of compa- 
rability, all testing was conducted at the end of the school year. The four countries 
on a Southern Hemisphere school schedule (Australia, Korea, New Zealand, and 
Singapore) tested in September through November of 1994, which was the end of 
the school year in the Southern Hemisphere. The remaining countries tested the 
mathematics and science achievement of their students at the end of the 1994-95 
school year, most often in May and June of 1995. Because Argentina, Italy, and 
Indonesia were unable to complete the steps necessary to appear in this report, the 
tables throughout the report do not include data for these three countries. Results 
also are not presented for Mexico, which chose not to release its seventh- and 
eighth-grade results in the international reports. 



2 Beaton, A.E., Martin, M.O., Mullis, I.V.S., Gonzalez, E.J., Smith, T.A., and Kelly, D.L. ( 1996). Science 
Achievement in the Middle School Years: ISA's Third International Mathematics and Science Study (TIMSS/. 
Chestnut Hill, MA: Boston College. 
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Table 1 



Countries Participating in TIMSS 1 



Argentina 


• Korea, Republic of 


Australia 


• Kuwait 


Austria 


• Latvia 


Belgium * 


• Lithuania 


Bulgaria 


• Mexico 


Canada 


• Netherlands 


Colombia 


• New Zealand 


Cyprus 


• Norway 


Czech Republic 


• Philippines 


Denmark 


• Portugal 


England 


• Romania 


France 


• Russian Federation 


Germany 


• Scotland 


Greece 


• Singapore 


Hong Kong 


• Slovak Republic 


Hungary 


• Slovenia 


Iceland 


• South Africa 


Indonesia 


• Spain 


Iran, Islamic Republic 


• Sweden 


Ireland 


• Switzerland 


Israel 


• Thailand 


Italy 


• United States 


Japan 

* The Flemish and French educational systems in Belgium participated separately. 












Argentina, Italy, and Indonesia were unable to complete the steps necessary for their data to appear in this report. 
Because the characteristics of its school sample are not completely known, achievement results for the Philippines 
are presented in Appendix C. Mexico participated in the testing portion of TIMSS, but chose not to release its results 
at grades 7 and 8 in the international report. 
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Table 2 shows information about the lower and upper grades tested in each country, 
including the country names for those two grades and the years of formal schooling 
students in those grades had completed when they were tested for TIMSS. Table 2 
reveals that for most, but not all, countries, the two grades tested represented the 
seventh and eighth years of formal schooling. Thus, solely for convenience, the 
report often refers to the upper grade tested as the eighth grade and the lower grade 
tested as the seventh grade. As a point of interest, a system-split (where the lower 
grade was in upper primary and the upper grade was in lower secondary) occurred 
in six countries: New Zealand, Norway, the Philippines, South Africa, Sweden, and 
Switzerland. Two countries, Israel and Kuwait, tested only at the upper grade. 

Having valid and efficient samples in each country is crucial to the quality and 
success of any international comparative study. The accuracy of the survey results 
depends on the quality of sampling information available, and particularly on the 
quality of the samples. TIMSS developed procedures and guidelines to ensure that 
the national samples were of the highest quality possible. Standards for coverage of 
the target population, participation rates, and the age of students were established, 
as were clearly documented procedures on how to obtain the national samples. For 
the most part, the national samples were drawn in accordance with the TIMSS 
standards, and achievement results can be compared with confidence. However, 
despite efforts to meet the TIMSS specifications, some countries did not do so. 
These countries are specially annotated and/or shown in separate sections of the 
tables in this report. 4 



3 
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4 The TIMSS sampling requirements and the outcomes of the sampling procedures are described in Appendix A. 



Information About the Grades Tested 



£ 

Country I 

% 


^Country's Name for-vC 
gp" Lower Grade ■. . . jg 


jgp$Years of Formafe^ jj 
^Schooling including^: | 
p^Stower-Grade.®^^ < 


^Country's NamePor 
^&Upper.Qra«lfic-^ 


Y-YtoredFormal^; 
.^Schooling including 

■ UpperGrade fe; L 


2 Australia 
Austria 
Belgium (FI) 
Belgium (Fr) 
Bulgaria 


7 or 8 
3. Klasse 
1 A 
1 A 


7 or 8 
7 
7 
7 
7 


8 or 9 8 or 9 

4. Klasse 8 

2A&2P 8 

2A&2P 8 

8 8 


Canada 

Colombia 

Cyprus 

Czech Republic 
Denmark 


7 7 
7 7 
7 7 

j 7 
6 6 


8 8 

8 8 

8 8 

8 8 

7 7 


England 

France 

Germany 
Greece 
Hong Kong 


Year 8 8 

Seme 7 

7 7 

Seconaary 1 7 

Seconaary 1 7 


Year 9 9 

4eme (90%) or 4eme 8 

Technologique (10%) 

8 8 

Secondary 2 8 

Secondary 2 8 


Hungary 

Iceland 

Iran. Islamic Rep. 

Ireland 

Israel 


7 7 

7 7 

1st Year 7 


8 8 

8 8 

8 8 

2nd Year 8 

8 8 


Japan 

Korea. Republic of 

Kuwait 

Latvia 

Lithuania 


1 st Grade Lower Secondary 7 

1 st Grade Middle' School 7 

7 7 

7 7 ___ 


2nd Grade Lower Secondary 8 

2nd Grade Middle School 8 

9 9 

8 8 

8 8 


Netherlands 
34 New Zealand 
3 Norway 
3 Philippines 
Portugal 


Secondary 1 7 

Form 2 7.5 - 8.5 

6 6 

Grade 6 Elementary 6 

Grade 7 7 


Secondary 2 8 

Form 3 8.5 * 9.5 

7 7 

1st Year High School 7 

Grade 8 8 


Romania 

5 Russian Federation 
Scotland 
Singapore 
Slovak Republic 


7 7 

7 6 or 7 

Secondary 1 8 

Secondary i 7 

7 7 


8 8 

g 7 or 8 

Secondary 2 9 

Secondary 2 8 

8 8 


Slovenia 

Spain 

3 South Africa 
3 Sweden 
3 Switzerland 
(German) 

(French and Italian) 


7 7 

7 EGB 7 

Standard 5 7 

6 6 

6 6 

- 7 


8 8 

8 EGB 8 

Standard 6 8 

7 7 

7 7 

8 ___J 


Thailand 
United States 


Secondary 1 7 

7 7 


Secondary 2 8 

8 8 



(International Standard Classification of Education Level 1). Does not include preprimary education. 

Australia: Each state/territory has its own policy regarding age of entry to primary school. In 4 of the 8 states/territories L Q 
students were sampled from grades 7 and 8: in the other four states/territories students were sampled from grades a ana y. 

indicates that there is a system-split between the lower and upper grades. In Switzerland there is a system-split in 14 of 26 cantons. 

J New Zealand; The majority of students begin primary school on or near their 5th birthday so the "years of formal schooling vary 
' Russian Federation; 70% of students in the seventh grade have had 6 years of formal schooling; 70% in the eighth grade have a y 

SOURCeI^IEa' TO rd International Mathematics and Science Study (TIMSS). 1994-95. Information provided by TIMSS National Research Coordinators. 
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What Was the Nature of the Mathematics Test? 

Together with the quality of the samples, the quality of the test also receives considerable 
scrutiny in any comparative study. All participants wish to ensure that the achievement 
items are appropriate for their students and reflect their current curriculum. Developing 
the TIMSS tests was a cooperative venture involving all of the NRCs during the 
entire process. Through a series of efforts, countries submitted items that were reviewed 
by mathematics subject-matter specialists, and additional items were written to ensure 
that the desired mathematics topics were covered adequately. Items were piloted, 
the results reviewed, and new items were written and piloted. The resulting TIMSS 
mathematics test contained 151 items representing a range of mathematics topics 
and skills. 

The TIMSS curriculum frameworks described the content dimensions for the TIMSS 
tests as well as performance expectations (behaviors that might be expected of students 
in school mathematics). 5 Six content areas are covered in the mathematics test taken 
by seventh- and eighth-grade students. These areas and the percentage of the test 
items devoted to each include: fractions and number sense (34%); measurement 
(12%); proportionality (7%); data representation, analysis, and probability (14%); 
geometry (15%); and algebra (18%). The performance expectations include: 
knowing (22%); performing routine procedures (25%); using complex procedures 
(21%); and solving problems (32%). 

About one-fourth of the questions were in the free-response format, requiring students 
to generate and write their answers. These questions, some of which required 
extended responses, were allotted approximately one-third of the testing time. 
Responses to the free-response questions were evaluated to capture diagnostic 
information, and some were scored using procedures that permitted partial credit. 6 
Chapter 3 of this report contains 33 example items illustrating the range of mathematics 
concepts and processes addressed by the TIMSS test. 

The TIMSS tests were prepared in English and translated into 30 additional languages 
using explicit guidelines and procedures. A series of verification checks were conducted 
to ensure the comparability of the translations. 7 

The tests were given so that no one student took all of the items, which would have 
required more than three hours. Instead, the test was assembled in eight booklets, 
each requiring 90 minutes to complete. Each student took only one booklet, and the 
items were rotated through the booklets so that each one was answered by a repre- 
sentative sample of students. 



5 Robitaille, D.F, McKnight, C.C., Schmidt, W.H., Britton, E.D., Raizen, S.A., and Nicol, C. (1993). TIMSS 
Monograph No. 1: Curriculum Frameworks for Mathematics and Science. Vancouver, B.C.: Pacific 
Educational Press. 

6 TIMSS scoring reliability studies within and across countries indicate that the percent of exact agreement for 
correctness scores averaged well above 90%. For more details, see Appendix A. 

7 See Appendix A for more information about the translation procedures. 
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TIMSS conducted a Test-Curriculum Matching Analysis whereby countries examined 
the TIMSS test to identify items measuring topics not addressed in their curricula. 
The analysis showed that omitting such items for each country had little effect on the 
overall pattern of achievement results across all countries. 8 

How Do Country Characteristics Difer? 

International studies of student achievement provide valuable comparative information 
about student performance and instructional practices. Along with the benefits of 
international studies, though, are challenges associated with comparing achievement 
across countries, cultures, and languages. In TIMSS, extensive efforts were made to 
attend to these issues through careful planning and documentation, cooperation 
among the participating countries, standardized procedures, and rigorous attention 
to quality control throughout. 9 

Beyond the integrity of the study procedures, the results of comparative studies such 
as TIMSS also need to be considered in light of the larger contexts in which students 
are educated and the kinds of system-wide factors that might influence students’ 
opportunity to learn. A number of these factors are more fully described in National 
Contexts for Mathematics and Science Education: An Encyclopedia of the Education 
Systems Participating in TIMSS', 10 however, some selected demographic characteristics 
of the TIMSS countries are presented in Table 3. Table 4 contains information about 
public expenditure on education. The information in these two tables shows that some 
of the TIMSS countries are densely populated and others are more rural, some are 
large and some small, and some expend considerably more resources on education 
than others. Although these factors do not necessarily determine high or low 
performance in mathematics, they do provide a context for considering the difficulty 
of the educational task from country to country. 

Describing students’ educational opportunities also includes understanding the 
knowledge and skills that students are supposed to master. To help complete the 
picture of educational practices in the TIMSS countries, mathematics and curriculum 
specialists within each country provided detailed categorizations of their curriculum 
guides, textbooks, and curricular materials. The initial results from this effort can be 
found in two reports, entitled Many Visions, Many Aims: A Cross-National Investigation 
of Curricular Intentions in School Mathematics and Many Visions, Many Aims: 

A Cross-National Investigation of Curricular Intentions in School Science 



8 Results of the Test-Curriculum Matching Analysis are presented in Appendix B. 

9 Appendix A contains an overview of the procedures used and cites a number of references providing details 
about TIMSS methodology. 



,0 Robitaille D.F. (in press). Notional Contexts for Mathematics and Science Education: An Encylopedia of the 
Education Systems Participating in TIMSS. Vancouver, B.C.: Pacific Educational Press. 

n Schmidt, W.H., McKnighf, C.C., Valverde, G. A., Houang, R.T., and Wiley, D. E. (in press). Many Visions, 
Many Aims: A Cross-National Investigation of Curricular Intentions in School Mathematics. Dordrecht, the 
Netherlands: Kluwer Academic Publishers. Schmidt, W.H., Raizen, S.A., Britton, E.D., Bianchi, L.J., and Wolfe, 
R.G., (in press). Many Visions, Many Aims: A Cross-National Investigation of Curricular Intentions in School 
Science. Dordrecht, the Netherlands: Kluwer Academic Publishers. 
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Table 3 



Selected Demographic Characteristics of TIMSS Countries 



Country 


Population 
Size (1,000) 1 


Area of 
Country 
(1000 
Square 
Kilometers) 2 


Density 
(Population 
per Square 
Kilometer) 3 


Percentage 

of 

Population 
Living in 
Urban Areas 


Life 

Expectancy 4 


Percent in 
Secondary 
School 5 


Australia 


17843 


7713 


2.29 


84.8 


77 


84 


Austria 


8028. 


84 


95.28 


55.5 


77 


107 


Belgium 


10116 


31 


330.40 


96.9 


76 


103 


Bulgaria 


8435 


111 


76.39 


70.1 


71 


68 


Canada 


29248 


9976 


2.90 


76.7 


78 


88 


Colombia 


36330 


1139 


31.33 


72.2 


70 


62 


Cyprus 


726 


9 


77.62 


53.6 


77 


95 


Czech Republic 


10333 


79 


130.99 


65.3 


73 


86 


Denmark 


5205 


43 


120.42 


85.1 


75 


114 


6 England 


48533 


130 


373.33 


- 


77 


- 


France 


57928 


552 


104.56 


72.8 


78 


106 


Germany 


81516 


357 


227.39 


86.3 


76 


101 


Greece 


10426 


132 


78.63 


64.7 


78 


99 


7 Hong Kong 


6061 


1 


5691.35 


94.8 


78 


98 


Hungary 


10261 


93 


110.03 


64.2 


70 


81 


Iceland 


266 


103 


2.56 


91.4 


79 


103 


Iran 


62550 


1648 


36.98 


58.5 


68 


66 


Ireland 


3571 


70 


50.70 


57.4 


76 


105 


Israel 


5383 


21 


252.14 


90.5 


77 


87 


Japan 


124961 


378 


329.63 


77.5 


79 


96 


Korea, Republic of 


44453 


99 


444.92 


79.8 


71 


93 


Kuwait 


1620 


18 


80.42 


96.8 


76 


60 


Latvia 


2547 


65 


40.09 


72.6 


68 


87 


Lithuania 


3721 


65 


57.21 


71.4 


69 


78 


Netherlands 


15381 


37 


409.30 


88.9 


78 


93 


New Zealand 


3493 


271 


12.78 


85.8 


76 


104 


Norway 


4337 


324 


13.31 


73.0 


78 


116 


Philippines 


67038 


300 


218.83 


53.1 


65 


79 


Portugal 


9902 


92 


106.95 


35.2 


75 


81 


Romania 


22731 


238 


95.81 


55.0 


70 


82 


Russian Federation 


148350 


17075 


8.70 


73.2 


64 


88 


8 Scotland 


5132 


79 ! 


65.15 


- 


75 


- 


Singapore 


2930 


1 


4635.48 


100.0 


75 


84 


Slovak Republic 


5347 


49 


108.61 


58.3 


72 


89 


Slovenia 


1989 


20 


97.14 


62.7 


74 


85 


South Africa 


40539 


1221 


32.46 


50.5 


64 


77 


Spain 


39143 


505 


77.43 


76.3 


77 


113 


Sweden 


8781 


450 


19.38 


83.1 


78 


99 


Switzerland 


6994 


41 


168.03 


60.6 


78 


91 


Thailand 


58024 


513 


111.76 


31.9 


69 


37 


United States 


260650 


9809 


27.56 


76.0 


77 


97 



’Estimates for 1994 based, in most cases, on a de facto definition. Refugees not permanently settled in the country of asylum 
are generally considered to be part of their country of origin. 

2 Area is the total surface area in square kilometers, comprising all land area and inland waters. 

3 Density is population per square kilometer of total surface area. 

‘Number of years a newborn infant would live if prevailing patterns of mortality at its birth were to stay the same throughout its life. 
“Gross enrollment of all ages at the secondary level as a percentage of school-age children as defined by each country. This 
may be reported in excess of 100% if some pupils are younger or older than the country’s standard range of secondary school age. 
6 Annual Abstract of Statistics 1995, and Office of National Statistics. All data are for 1993. 

7 Number for Secondary Enrollment is from Education Department (1985) Education Indicators for the Hong Kong Education 
System (unpublished document). 

8 Registrar General for Scotland Annual Report 1995 and Scottish Abstract of Statistics 1993. 

( - ) A dash indicates the data were unavailable. 

SOURCE: The World Bank, Social Indicators of Development, 1996. 
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Table 4 



Public Expenditure on Education at Primary and Secondary Levels 1 
in TIMSS Countries 



Country 


Gross National 
Product per Capita 
(US Dollars) 2 


Gross National 
Product per Capita 
(Inti. Dollars) 3 


Public Expenditure 
on Education (Levels 
1 & 2) as % of Gross 
National Product 4 


Public Expenditure I 

on Education I 

(Inti. Dollars per I 

Capita) 5 1 


Australia 


17980 


19000 


3.69 


701 


Austria 


24950 


20230 


4.24 


858 


Belgium 


22920 


20450 


3.70 


757 


Bulgaria 


1160 


4230 


3.06 


129 


Canada 


19570 


21230 


4.62 


981 


Colombia 


1620 


5970 


2.83 


169 


6 Cyprus 


10380 


- 


3.60 




Czech Republic 


3210 


7910 


3.75 


297 


Denmark 


28110 


20800 


4.80 


998 


7 England 


18410 


18170 


3.57 


649 


France 


23470 


19820 


3.61 


716 


Germany 


25580 


19890 


2.43 


483 


Greece 


7710 


11400 


2.27 


259 


8 Hong Kong 


21650 


23080 


1.34 


309 


Hungary 


3840 


6310 


4.31 


272 


Iceland 


24590 


18900 


4.77 


902 


Iran 


- 


4650 


3.93 


183 


Ireland 


13630 


14550 


4.21 


613 


Israel 


14410 


15690 


3.72 


584 


Japan 


34360 


21350 


2.82 


602 


Korea, Republic of 


8220 


10540 


3.43 


362 


Kuwait 


19040 


24500 


3.46 


848 


Latvia 


2290 


5170 


2.85 


147 


Lithuania 


1350 


3240 


2.18 


71 


Netherlands 


21970 


18080 


3.30 


597 


New Zealand 


13190 


16780 


3.15 


529 


Norway 


26480 


21120 


5.26 


1111 


Philippines 


960 


2800 


1.78 


50 


Portugal 


9370 


12400 


2.98 


370 


Romania 


1230 


2920 


1.89 


55 


Russian Federation 


2650 


5260 


- 


- 


7 Scotland 


18410 


18170 


3.57 


649 


Singapore 


23360 


21430 


3.38 


724 


Slovak Republic 


2230 


6660 


2.69 


179 


Slovenia 


7140 


- 


4.20 




South Africa 


3010 


- 


5.12 


- 


Spain 


13280 


14040 


3.17 


445 


Sweden 


23630 


17850 


4.92 


878 


Switzerland 


37180 


24390 


3.72 


907 


Thailand 


2210 


6870 


3.00 


206 


United States 


25860 


25860 


4.02 


1040 



and Secondary (level 2) vary depending on the country. 

2 SOURCE: The World Bank Atlas. 1 996. Estimates for 1 994 at current market prices in U.S. dollars, calculated by the conversion method used 
for the World Bank Atlas. 

3 SOURCE: The World Bank Atlas. 1996. Converted at purchasing power parity (PPP). PPP is defined as number of units of a country s currency 
required to buy same amounts of goods and services in domestic market as one dollar would buy in the United States. 

"SOURCE: UNESCO Statistical Yearbook, 1995. Calculated by multiplying the Public Expenditure on Education as a % of GNP by the percentage 
of public education expenditure on the first and second levels of education. Figures represent the most recent figures released. 

'Calculated by multiplying the GNP per Capita (Inti. Dollars) column by Public Expenditure on Education. 

6 GNP per capita figure for Cyprus is for 1 993. 

7 The figures for England and Scotland are for the United Kingdom. 

0 Calculated using Education Department (1985) Education Indicators for the Hong Kong Education System (unpublished document). 

( - ) A dash indicates the data were unavailable. 
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Depending on the educational system, students’ learning goals are commonly set at 
one of three main levels: the national or regional level, the school level, or the 
classroom level. Some countries are highly centralized, with the ministry of education 
(or highest authority in the system) having exclusive responsibility for making the 
major decisions governing the direction of education. In others, such decisions are 
made regionally or locally. Each approach has its strengths and weaknesses. Centralized 
decision making can add coherence in curriculum coverage, but may constrain a school 
or teacher’s flexibility in tailoring instruction to the different needs of students. 

Figures 1, 2, and 3 show the degree of centralization in the TIMSS countries 
regarding decision-making about curriculum syllabi, textbooks, and examinations. 
Thirty of the TIMSS participants reported nationally-centralized decision-making 
about curriculum. Fewer countries reported nationally-centralized decision-making 
about textbooks, although 16 participants were in this category. Thirteen countries 
reported nationally-centralized decision-making about examinations. Regional 
decision-making about these three aspects of education does not appear very common 
among the TIMSS countries, with only a few countries reporting this level of 
decision-making for curriculum syllabi and textbooks, and none reporting it for 
examinations. 

Most countries reported having centralized decision-making for one or two of the 
areas and “not centralized” decision-making for one or two of the areas. However, 
six countries - Bulgaria, Hong Kong, Lithuania, the Philippines, Romania, and 
Singapore - reported nationally-centralized decision-making for all three areas: 
curriculum syllabi, textbooks, and examinations. Six countries - Australia, Hungary, 
Iceland, Latvia, Scotland, and the United States - reported that decision-making is 
not centralized for any of these areas. 
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